Missing Release Notes

Extracted Release Notes

• Add cauchy_cdf and inverse_cauchy_cdf functions #15818 (Author: Jeremy Craig Sawruk): Add cauchy_cdf and inverse_cauchy_cdf functions
  • Add Cauchy distribution CDF and inverse CDF functions to MathFunctions.java.
• Cassandra Performance Improvement #16104 (Author: 护城): Cassandra Performance Improvement
  • Improve cassandra query performance by adding meta cache to avoid too many remote meta operations to the cassandra server.
• Add client tags info to ConnectorSession #16287 (Author: Neerad Somanchi): Add client tags info to ConnectorSession
  • Add getClientTags to ConnectorSession.
• Extend memory exceeded errors with more details #16297 (Author: Andrii Rosa): Extend memory exceeded errors with more details
  • Add additional details to memory exceeded error messages to simplify debugging. Disabled by default. Can be enabled by setting the "verbose_exceeded_memory_limit_errors_enabled" session property to "true".
• Implement collection of min/max values in DynamicFilterSourceOperator #16314 (Author: Roman Zeyde): Implement collection of min/max values in DynamicFilterSourceOperator
  • Allow dynamic filtering for large number of collected values by converting the predicate into a range.
• Add SQL functions ARRAY_DUPES and ARRAY_HAS_DUPES #16317 (Author: Pranjal Shankhdhar): Add SQL functions ARRAY_DUPES and ARRAY_HAS_DUPES
  • Add SQL functions :func:array_dupes and :func:array_as_dupes.
• Add support for partition schema evolution for HUDI tables #16348 (Author: Jalpreet Singh Nanda (:imjalpreet)): Add support for partition schema evolution for HUDI tables
  • Add support for allowing to match columns between table and partition schemas by names for HUDI tables. This is enabled when configuration property hive.parquet.use-column-names or the hive catalog session property parquet_use_column_names is set to true. By default they are mapped by index.
• Fix some issues in SQL function #16365 (Author: Rongrong Zhong): Fix some issues in SQL function
  • Fix issues in SQL functions where query might fail with compiler error when function implementation includes lambda variable that has the same name as column names or function input names.
• Fix column in parquet dereference pushdown #16377 (Author: Chen): Fix column in parquet dereference pushdown
  • Fixes a bug in Parquet dereference pushdown. The issue causes column name not picked up properly, resulting in inconsistent query result in certain cases.
• Add ORC support for iceberg connector #16391 (Author: Junyi Huang): Add ORC support for iceberg connector
  • Add ORC support for iceberg connector.
• Allow dynamic filtering with comparison operators #16401 (Author: Zhenxiao Luo): Allow dynamic filtering with comparison operators
  • Support dynamic filtering with comparison operators.
• Fix incorrect pushdown if IS NULL predicate in Elasticsearch #16428 (Author: Zhenxiao Luo): Fix incorrect pushdown if IS NULL predicate in Elasticsearch
  • Fix incorrect pushdown if IS NULL predicate in Elasticsearch.

All Commits

• efea31c Fix doc issue on deployment page, so that copy command does not include the $. Fixes Code section in docs is incorrectly copied along with '$' prompt #15735 (Marilyn Beck)
• 12742bb Optimize GroupedTopNBuilder (James Petty)
• b6f86bf Add utility methods to ObjectBigArray (James Petty)
• a4f103e Avoid boxing in SimplePagesIndexComparator (James Petty)
• a4caff6 Avoid boxing in SimplePageWithPositionComparator (James Petty)
• 9c07912 Enhance BenchmarkGroupedTopNBuilder (James Petty)
• 4d32a82 Simplify PagePartitioner inner loop conditional branching (James Petty)
• 95ab9e9 Close systemMemoryContext in PartitionedOutputOperator#close() (James Petty)
• 45d7540 Implement mayHaveNull() for Dictionary, RLE, and GroupById Blocks (James Petty)
• 9b5a247 Allow dynamic filtering with comparison operators (Zhenxiao Luo)
• 396913e Remove redundant function in PredicatePushdown for dynamic filtering (Zhenxiao Luo)
• b0d8a70 Extend OperatorType to support dynamic filter comparison operators (Zhenxiao Luo)
• 5633ed8 Add Cauchy distribution functions (Jeremy Craig Sawruk)
• c6cfafd [thrift connector] Add property to forward user via Thrift Header (derektbrown)
• 1c3d141 Fix incorrect pushdown if IS NULL predicate in Elasticsearch (Zhenxiao Luo)
• e14ba2b Order RuntimeStats by metric name in coordinator UI and cli (Zhan Yuan)
• ad538e1 Add task-level RuntimeStats (Zhan Yuan)
• b1f76c6 Fall back on shared dictionaries when available (Huameng Jiang)
• d46b497 Remove unnecessary locking in SqlStageExecution (Zhenxiao Luo)
• d3823d5 Add ORC support for iceberg connector (Junyi Huang)
• b330d56 Upgrade orc-protobuf version to 12 and add attributes to OrcType (Junyi Huang)
• 5090612 Add support for partition schema evolution for HUDI tables (Jalpreet Singh Nanda (:imjalpreet))
• 22097e8 Fix SetOperation(UNION/INTERSECT/EXCEPT) for Pinot Connector to pushdown sub-queries (Xiang Fu)
• fc1a5ac Fix lambda scope issues in SQL functions (Rongrong Zhong)
• 8dfa3c3 Move InlineSqlFunctions to beginning of plan optimizers (Rongrong Zhong)
• 7c8bc70 Fix SQL function interpretation in expression interpreters (Rongrong Zhong)
• 79d8a59 Resolve enum literal only when dereference expression base type is enum (Rongrong Zhong)
• ab404ca Add materialized view query optimization utility (Julian Zhuoran Zhao)
• 5d150f7 Extend memory exceeded errors with more details (Andrii Rosa)
• 5ff5a34 Implement Z-Order curve search function (Grace Xin)
• 2319779 Implement collection of min/max values in DynamicFilterSourceOperator (Roman Zeyde)
• ea8d267 Add SQL functions for array dupes (Pranjal Shankhdhar)
• 700f324 Fix dupe expression error in orderings (Pranjal Shankhdhar)
• 6d19caa Improve cassandra query performance by adding metadata cache (护城)
• af61b56 Fix typo in aggregate.rst (jiachen)
• 6b34a87 Fix typo in CostCalculatorWithEstimatedExchanges (lijieliang)
• ca3db02 Ensure server tests are included in CI (Tim Meehan)
• 25de3d7 Show RuntimeStats in the Presto query Web UI (Zhan Yuan)
• 3cc2a27 Record #bytes read from cache and external (Zhan Yuan)
• c1125e4 Expose RuntimeStats and aggregate them at query level (Zhan Yuan)
• 8f47664 Add RuntimeStats to track more operator stats (Zhan Yuan)
• dd24f15 Update README.md (James Xu)
• 3250e9c Claim that MODULE_WORKING_DIR can also be used as working dir (护城)
• 109d9a0 Fix column name in parquet dereference pushdown (Chen)
• 91395db Disable flaky test 'testGetQueryInfos'. (Sergey Pershin)
• 40bfcf5 add client tags info to ConnectorSession (Neerad Somanchi)